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Abstract In the framework of a random assignment process — which randomly 
assigns an index within a finite set of labels to the points of an arbitrary set — we 
study sufficient conditions for a strong law of large numbers and a De Finetti theorem. 
In particular, this yields a family of finite-valued nonexchangeable random variables 
that are conditionally independent given some other random variable, that is, they 
verify a De Finetti theorem. We show an application of the De Finetti theorem and the 
law of large numbers to an estimation problem. 
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1 Introduction 

In the probability literature, a De Finetti theorem usually refers to a result ensuring 
that some random variables are conditionally independent given some other random 
variable. In this sense, the classical De Finetti theorem states that an infinite number 
of exchangeable random variables {F, } i£ / taking values in {0, 1} are conditionally 
independent (and so, they are conditionally i.i.d.); see, e.g., Feller (1966), Fristedt 
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and Gray (1997). Here, exchangeability means invariance of the distribution under 
finite permutations of the terms; so that any finite vector (Yj, , . . . , Yj n ) has the same 
distribution, which depends only on n. De Finetti (1930) proved that there is a random 
variable £ with values in [0, 1] such that, conditional on f , the T, are i.i.d. random 
variables with % = P{Yi = I \ 

Generalizations of this "first" De Finetti theorem were aimed towards showing 
that exchangeable random variables taking values in domains L larger that {0, 1} are 
conditionally independent as well. De Finetti (1937) has given a proof for real-valued 
random variables, £ being now an arbitrary distribution on K. Later, Hewitt and Savage 
(1955) proved the result when L is an arbitrary compact Hausdorff space. The case 
of a Borel space L (isomorphic to some Borel subset of [0, 1] endowed with its Borel 
sigma-field) is studied in Fristedt and Gray (1997, Chapter 27) and Kallenberg (1997, 
Chapter 8). However, Dubins and Freedman (1979) give an example showing that this 
theorem might fail in a separable metric space. 

Finite families of exchangeable random variables have also been studied, since 
they are related to sampling without replacement from a finite population. More pre- 
cisely, £ is then replaced by the (random) empirical distribution and, conditional on £, 
(Y\, . . . ,Y n ) arise from sampling without replacement from the support of Diaco- 
nis and Freedman (1980a) deal with this case and analyze the total variation distance 
between the distribution of (Y\, . . . , Y n ) and the closest mixture of i.i.d. random vari- 
ables, as a method for proving the De Finetti theorem. See also Kerns and Szekely 
(2006). 

De Finetti's type results have also evolved in many different directions. For instance, 
Diaconis and Freedman (1980b) show that mixtures of recurrent Markov chains, 
obtained by randomly selecting the transition matrix, are characterized by "partial 
exchangeability", meaning that two sets of trajectories beginning with the same num- 
ber of transitions between each couple of states have the same probability. Continuous- 
time extensions of such results are given by Freedman (1996), not only for Markov 
chains but also for stationary independent increments' processes. 

The case of random arrays {X,-j},- ; € n satisfying exchangeability properties under 
separate or joint permutations of rows and columns has been independently analyzed 
by Aldous (1981, 1982) and Hoover (1982), and it was simplified and generalized by 
Kallenberg (1989, 1992). Dovbysh and Sudakov (1982) consider the case of symmet- 
ric positive definite random matrices invariant under permutations of their rows and 
columns. See also Panchenko (2010). 

Exchangeable partitions of a set of natural numbers were considered by Kingman 
(1978), motivated by some problems in population genetics. Later, Gnedin (1997), 
Gnedin and Pitman (2004), and Pitman (1995) pursued this topic. 

Exchangeable random measures /x, defined as those for which the random variables 
fi(Bi), . . . , fi{B n ) are exchangeable whenever X(B\) — ■ ■ ■ — X(B n ) for a given 
measure X, were first studied by Kallenberg (1973, 1975) and the results were collected 
in the monograph Kallenberg (1976). Closed random subsets McR with Lebesgue 
measure zero, whose complement is a disjoint union of open intervals (a;, &,•), are 
called exchangeable if, for each e > 0 and conditional on the number N € of intervals 
of length at least e, their lengths bi — at are an exchangeable sequence. Their study 
has been considered in Kallenberg (1982a, b). 
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For more details and other issues, two specific monographs have been written by 
Aldous (1985) and, more recently, by Kallenberg (2005). 

As can be seen, De Finetti's theorems are mostly related to some kind of exchange- 
ability or symmetry adapted to the context of the problem, which implies that, condi- 
tional on a random selection of some parameters, the involved random variables have 
not only independence properties, but also, as a consequence of the symmetry, some 
homogeneity in their distributions (in most cases they are identically distributed). 

Our recent research, however, has focused on obtaining De Finetti's theorems with- 
out exchangeability assumptions. In this sense, sufficient conditions for a family 
{Y(x)} xe E of non-identically distributed {0, l}-valued random variables to verify a 
De Finetti theorem are proposed in Velez and Prieto-Rumeau (2009, 201 1) by intro- 
ducing the concept of a (weighted) random selection process, with Y(x) — 1 when 
the element x e E is "selected", while Y(x) — 0 if x e E is "rejected". Then, under 
adequate hypotheses, the random variables {Y(x)} x£ e are shown to be conditionally 
independent, though they are neither i.d. nor exchangeable (this {0, 1} case is related 
to a short paper by Pitman 1978). In Velez and Prieto-Rumeau (2010) we have proved 
that these hypotheses are also necessary to get a De Finetti theorem for such random 
selection processes. 

In Velez and Prieto-Rumeau (2008), a generalization of the random selection 
processes was proposed, named random assignment processes. The random variables 
{Y(x)} xe E are now supposed to take values in a finite set L = {0, 1, . . . , I}. So, the 
value of Y(x) can be interpreted as the label or index assigned to the point x G E. 
The labels are assumed to be randomly assigned according to a multidimensional 
weight function (the details are given in Sect. 2 below). Then, under further appro- 
priate conditions, it is shown that the L-valued random variables {Y(x)} xe E satisfy 
a De Finetti theorem, that is, they are conditionally independent though, once again, 
they are neither i.d. nor exchangeable. In the present paper, the sufficient conditions 
for a De Finetti theorem proposed in Velez and Prieto-Rumeau (2008) are widely 
generalized, and in particular, we give a satisfactory answer to the conjecture stated 
in the conclusions of Velez and Prieto-Rumeau (2008). In addition, a strong law of 
large numbers (related to the random variable with respect to which the {Y(x)} x6 e 
are conditionally independent) is studied. 

In the literature there is an exception to the fact that the De Finetti theorem is related 
to identically distributed random variables. This has to do with the relations between 
the De Finetti theorem and sufficiency, as initially explored by Dynkin (1978) and 
Lauritzen (1982); a key result in this sense is given in Diaconis and Freedman (1984, 
Theorem 1.1) that is also included in Aldous (1985, Section 18). The corresponding 
setting is a sequence of random variables (Xi, . . . , X n , , . .) such that a sufficient 
statistic T n exists for each n > 1 and the conditional distribution of (X\, . . . , X n ) 
given T„ — t is Q n (t, •), which must satisfy some compatibility assumptions. The 
class M of distributions P of the sequence for which this statement is true, called 
partially exchangeable in Diaconis and Freedman (1984), is a convex set and there is 
a set A in 

£ = P) o{T n , X n+ \, X n+ 2, . . .) 
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with P(A) — 1 such that, in A, Q n (T„, ■) converges to a probability measure Q e M; 
these Q are trivial in £ and give the extremes of M. Any other P e M is a mixture 
of these g with respect to the restriction of P to E. However, this result does not 
ensure the independence of the random variables under the extremes of M; so that 
the theorem encompasses as well cases where the conditional independence of De 
Finetti's theorem is granted with others where it fails. 

In this context, our paper will show that the probability measure associated to a 
random assignment process is partially exchangeable, and gives conditions ensuring 
that the extreme distributions are multinomial-like distributions, so that the conditional 
independence of the variables indeed holds. The corresponding mixing probabilities 
are then supported on the multidimensional unit simplex. 

The rest of the paper is organized as follows. In Sect. 2 we give a formal definition of 
a random assignment process and state our main results, whose proofs are postponed 
to later sections. Namely, Sect. 3 proves several useful preliminary results, while the 
proofs of the strong law of large numbers and the De Finetti theorem are given in Sect. 
4. An application of the results in this paper to an estimation problem is studied in 
Sect. 5. Our conclusions are stated in Sect. 6. 



2 Random assignment processes 

Most of the material in this section is borrowed from Velez and Prieto-Rumeau (2008). 
For clarity of exposition, however, we will state the corresponding results. 

Let {Q, , T, P) be a probability space, with expectation operator E, let E be an 
arbitrary set, and consider the set of indices L — [0,1,2, ... ,£} for some positive 
integer £. Let Y — {Y{x)} x& e be a family of random variables 

Y(x) : £2 — > L for every x e E. 

There are no restrictions on the nature of the set E. It may be helpful, however, to 
think of £ as a subset of an Euclidean space. In this way, the random variable Y(x) 
assigns a color in L to the point x e E . Actually, we will see that the most challenging 
case is when £ is a denumerable set; surprisingly, our results are easier to obtain for 
an uncountable set E. In the sequel, we will impose some conditions — see (CI) and 
(C2) below — on the probability measure P so that Y has some suitable properties. 



2.1 Notation 

Let {e,-}i</<£ be the canonical basis of R ( , and leteo = 0 G M. 1 . The random variables 
Y(x) may be alternatively represented by means of the random vectors 

N(x) = e Y (x). 

Springer 



Random assignment processes 



Letting B be the ring of all finite subsets of E, we can define for each B e B 

N(B) = £ N(x) = (ATi(B), . . . , Ne(B)) 
xeB 

which takes values in 

R(#B) — [r eN l :r < #B}, 

where #B denotes the cardinal of the set B and 7 — Xf=i r i * s me sum of the 
components of r e N £ . We let Nq(B) — #B - Jj=i Ni(B), and accordingly, we 
define also ro = #B — r. Consequently, N(B) = r means that there are Nj(B) — r, 
points x in B with Y(x) — i (say, of color z) for each 0 < i < I. 

2.2 Invariant er-algebras 

On L we will consider the discrete er-algebra (consisting of all the subsets of L). On 
the set of all functions from E to L, denoted by L E , we will consider the product 
a -algebra; see Kallenberg (1997, p. 2). 

Given a finite set B e B, let Qb be the sub-a -algebra of T consisting of all the 
events of the form {Y e F], where F is a measurable subset of L E which is invariant 
under any permutation of the elements of B . Following the interpretation in terms of 
coloring, it should be evident that a family of colorings of the points in E is invariant 
under permutations of the elements of B if and only if the colors outside B are fixed, 
while the frequencies of each color inside B remain also fixed. In fact: 

Lemma 1 Given B e B, Qb is the smallest a -algebra for which N(B) and Y(x),for 
x e B c , are measurable, denoted by a (N '(B) , {Y(x)} xs b c )- 

For an arbitrary subset A C E, we define the er-algebra of events invariant under any 
finite permutation in A as 

Qa= p| Qb- (2.1) 
Obviously, if A\ C A2 then Qa 2 ^ Qai- 

2.3 Definition of a random assignment process 

Let m : E — >• (0, oo) e be an arbitrary function. We will refer to 

m(x) = (m\(x), . . . , mi(xj) 

as the vector of weights of x e E. Later, we will impose additional conditions on 
m. Given a finite set B e B, we will use the notation m, (B) = ^ xe g nti(x) for 
1 < i < I. 
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Definition 1 A family of L-valued random variables Y — [Y(x)} x sE on the prob- 
ability space (£2, T , P), or equivalently, the family N — {A f (B)}figB, is a random 
assignment process on E with weight function m (that will be also referred to as 
a random assignment process on (E, m)) if the following conditions hold for each 
B e B: 

(CI) Conditional on N(B), the random variables {Y(x)} xe B and {Y(x)} xe B c are 
independent. 1 

(C2) For all i = 1 1 and x e B, 

F{Y(x) = i | N{B)=e i }= T ^-. 

nii(B) 

The condition (CI) means that, once the numbers of the different indices attributed 
to the points inside B are known, their positions in B do not depend on the indices 
attributed to the points outside B ; this definition has a Markovian-like flavor. On the 
other hand, the condition (C2) establishes that if a unique positive index i G L is 
to be located in B, then this positive index corresponds to x G B with probability 
proportional to its weight m, (x). 

It is important to note that one of the basic issues that we shall discuss is the 
existence itself of a random assignment process for given E and m. 



2.4 Conditional distributions 

It is easy to prove Velez and Prieto-Rumeau (2008, Proposition 2.1) that for any B e B, 
r G R(#B), and any disjoint sets B\ , . . . , Bi C B with #B, = r,- for i — !,...,£, we 
have 



p| P| {Y(x) = i] | N(B) = r 



1 



S(B,r) 



I m x {x)--- Yl m t (x), (2.2) 



xeBi 



xeBi 



where the normalizing factor S(B, r) is the sum of the products in the righthand side 
of (2.2) over all the disjoint subsets of B with #Bj = r; for / = 1, . . . , I. In case that 
r £ R(#B), we define S(B, r) = 0. 

Fix B e B and a subset C C B. As a direct consequence of (2.2) (cf. Velez and 
Prieto-Rumeau 2008, Proposition 2.3), for any r e R(#B) and k e R(#C) such that 
r - k G R(#B - #C), the probability that N(C) = k conditional on N(B) — r is the 
following "generalized" multidimensional hypergeometric distribution 



P{N(C) = k | N(B) = r} 



S(C, k) S(B - C, r - k) 
S(B,r) ' 



(2.3) 



For a definition of conditional independence see Kallenberg (1997, p. 109). 
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More generally, if Ci , . . . , C s are disjoint subsets of B e B, then 

P{AT(Ci) =Jfci,..., N(C S ) = k s | N(B) = r] 
= S(C 0 ,ko)S(C 1 ,k 1 )---S(C s ,k s ) 
S(B,r) 

with Co — B — U* =1 C; and ko — r — Xr=i 
2.5 Marginal distributions 

The above results show that the distribution of the random assignment process N 
inside each B e Bis determined by the marginal distribution of N(B). Hence, the 
distribution of the random assignment process is completely determined by a family 
of compatible marginal distributions for each N (B) with B e B, meaning that for 
every disjoint B and C in B the total probability rule 

^ S(C,r)S(B,k) 
F{N(B) = k}= £ P{jV(£ UC)^ + f) / / \'\ (2.5) 
reR(#C) Mtfuc,/t + r) 

holds. 

Clearly, if E is finite, then we can choose an arbitrary distribution for N(E), and 
then derive the joint distributions of the random assignment process using (2.4) with 
B — E. Therefore, to avoid this trivial situation, in what follows we will assume that 
the set E is not finite. 

As shown in Velez and Prieto-Rumeau (2008, Proposition 2.5), an obvious choice 
of compatible marginal distributions for any E and m is the following mixture of 
"generalized" multinomial distributions: for B e B 

¥{N(B) = k} = 'J 1 ' " 1 0 F(d%) for all k e R(#B), (2.6) 

J At \AxeB$- m ( x ) 

where A £ = {§ e [0, 1] L : § • 1 = & + •••+& = 1} and F is an arbitrary distribution 
on Ai. We note that, to simplify some expressions, in (2.6) we let 

mo(x) — 1 and mix) — (mo(x), mi(x), . . . , mi(x)j forallxeZ?. 

Remark 1 Let us now comment on the particular case m, (x) = 1 for all i e L. In this 
case, S(B, r) equals the multinomial coefficient, that is, 



S(B,r)=[ ) = 

\r Q , r\,...,rt) 



#Bl 



and the random variables Y(x) are exchangeable; see Remark 2.4 in Velez and Prieto- 
Rumeau (2008). This also gives the intuition for the generalized multinomial distri- 
bution in (2.6). Obviously, the total probability rule (2.5) holds when the marginal 
distributions are multinomial. 
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Remark 2 In the previous setting, the index 0 e L seems to play a particular role as a 
"default" index. However, if m is a function from E to (0, oo) f+1 , with 

m{x) — (mo(x), m\(x), . . . , mi(x)) for x e E, 

then, replacing (C2) with 

(C2)' For all iJeL with i ^ j, 

_ m;(x)/m j(x) 

F{Y(x) = i | 7V, (fi) = 1, iV/CB) =#B - 1} - 



Z y sfi m ;(3')/ m /(v) 

we would reach identical results, with the factor n^es 0 inserted in the righthand 

side of (2.2). 

Thus, there is no loss of generality when letting j — 0 and mo(x) = 1 in (C2)'. 
This explains why, in the sequel, the index 0 has no special relevance whereas, on the 
contrary, the quotients mi(x)/m,j(x) will be particularly relevant for our analysis. 

In case that (2.6) holds for some F, the random variables {Y(x)} xe E are condition- 
ally independent given §, with conditional distributions 

c 1 J71 ' ( X i 

F{Y(x) = / | §} = P{N(x) = a | = for i e L. (2.7) 

§ • m(x) 

Therefore, we say that a De Finetti theorem holds. 



2.6 Main results 

Our goal in this paper is to give conditions on the weight function m ensuring that, 
given a random assignment process on (E, m), the marginal distributions N(B) for 
B e B are necessarily as in (2.6) for some distribution F on Af (and so, a De Finetti 
theorem holds). 

It was shown in Velez and Prieto-Rumeau (2008, Theorem 3.5) that a De Finetti 
theorem holds if the following condition is satisfied: 

Condition (A) There exists a sequence 2 A — {x„}„>i C E such that 

0 < lim rriiixn) < oo for every 1 < i < I. 

n— >oo 

Letting A n — {x q }\< q < n , the condition (A) above implies that the m, (A„) grow to 
infinity, as n — > oo, at the same speed (proportional to n) for all i e L. With respect 
to the strong law of large numbers, it is proved in Velez and Prieto-Rumeau (2008, 
Theorem 3.4) that as n — >• oo 

(N\{A n ) Ni(A n )\ 

I , . . . , I converges a.s. to a random vector § e Ag. (2.8) 

\ n n ) 



A sequence A = [x n } n> \ C E will always refer to a countable nonfinite subset of E. 
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It was also shown in Velez and Prieto-Rumeau (2008, Example 3.8) that any random 
assignment process on an uncountable set E satisfies condition (A). Therefore, the 
challenging case is precisely when the set E is countable. Here, we will improve Velez 
and Prieto-Rumeau (2008, Theorem 3.5) by replacing (A) with the weaker condition 
(A*) below, in which we will use the notation m j\i (x) — m j (x)/m.i (x) for x e E and 
i, j e L. 

Condition (A*) There exists a sequence A — {x n }„>i C E such that, for every ;' 
and j in L, the limit lim^oo mj\i(x n ) — m j\j exists, with 0 < m j\, < oo, and 
moreover, 

00 

m j\i( A ) = ^mj\i(x n ) = oo. 
n = \ 

We note that, regardless the condition (A*) holds, there is indeed a sequence A C E 
such that the limits m ;i, exist (just choose a suitable subsequence of any given sequence 
in E). Besides, the series m.j\i(A) diverges whenever m.j\i > 0. Hence, the condition 
(A*) just imposes the existence of a sequence A such that ntj\i(A) = oo even if 
m,j\i — 0. 

When (A) is replaced with (A*), the statement itself of the strong law of large 
numbers (2.8) becomes much more involved; see Theorem 2 below. To give an overall 
idea, let us mention that it establishes the existence of a random vector £ taking values 
in Ai such that, letting 

£2 M = {Ni(A) > 0 V / e M and Nj(A) = 0 V j M) 

for if C t, we have 




and moreover, for each M C L with P(£2m) > 0, there exists a set Co C M such that 
P(- | ^M)-a.s. the following limits hold as n — >• oo: for all i e Co 

> —, while — — y -± V j £ C 0 , 

n a 0 mj\i(A n ) u Q 

where ao = X/eCo '■ stron g l aw °f lar g e numbers allows to get the following 
De Finetti result. 

Theorem 1 Let Y be a random assignment process on (E, in), and suppose that the 
condition (A*) is verified for some sequence A C E. Then there exists a Q ^-measurable 
random vector § with values in Ai such that the random variables {Y(x)} xs e are 
conditionally independent given § and (2.7) holds, that is, 

c ' in ~ ( jc ) 

¥{Y(x) = i | £} = - — — for all x e E and i e L. 
| • m(x) 
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Consequently, for all B e B and k e R(#B), 



P{N(B) = k] = E 



#B-k ' 



(2.9) 



This results generalize the classical De Finetti theorem for sequences of exchangeable 
finite-valued random variables. The next result gives insight into the structure of the 
er -algebras Ga when (A*) holds. 

Corollary 1 Under the conditions of Theorem 1 we have Ga = o"(?) provided that 
both a -algebras are completed in T . More generally, for any E' C E such that 
A C E' , we have Ge' — <r(£) when both a -algebras are completed in T . 

In Sect. 3 we will prove several useful preliminary results that give a considerable 
insight into the behavior of any random assignment process along any sequence A C 
E. The proofs of Theorem 1 and Corollary 1 are given in Sect. 4. 



3 Preliminary results 

Throughout this section, we will suppose that A — {x n } n >i is a sequence in E and 
will use the notation A n = {x\, . . . ,x n } for n>\. 

Lemma 2 Let Y be a random assignment process on (E, m), and let A be an arbitrary 
sequence in E. Given any B, C G B with C C B U A, we have 

lim P{JV(C) = k | GbuaJ = P{N(C) = k | Gbua] a.s. 

n— >oo 

for any k e R(#C). Moreover, if C C B U A n (for large enough n ), it is 

S((B U A n ) - C, N(B U A n ) - k) 

F{N(C) = k | QbuaJ - S(C, k) n — i n) '-. (3.1) 

S(B U A„, N(B U A n )) 

Proof Note that {Gbua„}h>i is a reverse filtration, and therefore, the sequence 
{P{N(C) = k | Gbua„}}h>i is a reverse martingale. The convergence 

¥{N(C) = k | GbuaJ — ► P{^V(C) = A: | ^ UA } 

follows from the reverse martingale convergence theorem (see, e.g., Fristedt and Gray 
1997, p. 484). Now, as a consequence of the condition (CI), if C C BU A n then N (C) 
and {N(xq)} q>n are conditionally independent given N(B U A„). Therefore, 

¥{N(C) = k | g BLM „} = ¥{N(C) = k | N(B U A,,)}. 

Finally, according to (2.3), we conclude that (3.1) holds. □ 
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Lemma 2 above ensures that, for all k e R(#C), the limit 

S((B U A„) - C, N(B U A„) - k) 

lim 

n^oc S(B U A n , N(B U A„)) 

exists almost surely. It is also of particular interest to define, for each x e A and i e L, 
r]i(x) — ¥{Y(x) — i | Qa\, and so, almost surely, 

S(A n - x, N(A n ) - a) 
m (x) = P{Af(x) = e t | G A ] = mi(x) lim " ' . (3.2) 

n^oo S(A„,N(A„)) 

Then, by letting 

r]i(x)/mi(x) 



Z/eL r)j(x)/mj(x)' 
we have that (3.2) yields 

r S(A„-x,iV(A n )-e ; ) 

— = lim — a.s. (3.3) 

&(x) «^-oo S(A n — x, N(A n ) — 

for all x e A and i, j e L. Moreover, the £(x) = {^i(x)}j e i are random (im- 
measurable) probability vectors (that is, taking values in Ai) that allow to express 

• m ; (x) 

77,(x) = . 

ij (x) • »i (x) 

At this point, note that if we could show that £(x) does not depend on x, then we 
would be close to (2.7). As a first step towards this result, we will now show that 
the {t;i(x)} X £A are simultaneously positive or simultaneously zero, according to the 
presence or absence of the index i along the sequence A (that is, depending on whether 
Ni (A) > 0 or Ni (A) = 0). 

Proposition 1 Let Y be a random assignment process on (E, m) and let A be any 
sequence in E. For all i e L we have (up to sets of probability 0) 

{Ni(A) = 0} = {&(*) = 0, V x e A} = = 0}. (3.4) 

(Clearly, £;(x) may be replaced with r\i(x) in (3.4) above.) 

Proof Let Q be a measurable subset of £2 for which, for all x e A and i e L, r]i(x) 
equals 

S(A n -x,N(A n )- ei ) 

m,(x) lim 

»-oo S(A„, iV(A„)) 

(recall (3.2)) and X/sL 7 7/( x ) — !• According to Lemma 2, we have P(S2) = 1. In £2, 
if iV; (A) = 0 then jj f (x) = 0 for all x e A, since S(A„ - x, 2V(A„) -«,•) = 0. 
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On the other hand, for any x e A, the sequence 

S(A n -x,N(A„)- ei ) 
S(A n -xuN(A n )- ei ) 

is bounded by maxj m.j(x{)/m j(x). In fact, if r e R(n — 1) and B\, . . ., Bi are 
arbitrary disjoint subsets of A„ — x\, with #B; = r\ for all z = 1, ... ,1, it is 

S(A„-x,r) = ^ J ffli(x) 

Bi,...,B( xeB 1 

< max — S(A„ 

j nij(x) 

where, in each term, i e L is the index such that x e B, • . 
Therefore, if r?, (x\) = 0 then we also have 



xi, r) 



mj{xi) 
mi(x) 



m(x) — rtii(x) lim 



S(A n - x, N(A„) - e t ) S(A n - x u N(A n ) - e t ) 



S(A n -x u N(A n )- ei ) 



S(A n ,N(A n )) 



= 0 



for all x e A. Assume now that for some to e £2, it is r]i(x\) — 0 and Ni(A) > 0. 
Then 



tit (x) = ¥>{N(x) = e t | Ga] = 0 Vie A, and so F{Ni (A) > 0 | Qa] — 0 

(out of the negligible set where the latter probability does not match the sum of the 
former ones). But {A// (A) > 0} G Ga, so that l{]\r I (A)>0} is a version of the latter 
conditional probability which takes the value 1 at to. 
Hence, 



r ; = QnfoKxi) = o, Ni(A) > 0} 



is a set of probability 0. □ 

Exclude from £2 the negligible set LI/g^T,, so that £2 will denote the resulting set 
of probability one in which (3.4) holds for all i e L. For each nonempty M C L, let 

£2 M = £2 n {Ni (A) > 0, V i e M] n {iV; (A) = 0, V / g M} 
= £2n > 0, VieM}n{f;(*i) = 0, Vig"M}. 



On the one hand, £2m gives the set of trajectories of the random assignment process 
attributing indices exclusively in M to the elements of A. On the other hand, each £2 m 
is in correspondence with the face Am of Af defined as 



A M = {§ e At : ft > 0, V i e M and ft =0, Vi ^ AT}. 
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Remark 3 Obviously, we have £2 — (JmcL ^ ut ^ ^ gi yes positive probability 
to several of them, say, flj^,, Qmi, ■ ■ then P is the corresponding convex linear 
combination of 

P(. | n Ml ), P(- 1 Qjft),... 

Thus, when needed, we may suppose that P is concentrated on a single Qm and 
£2 = 



3.1 First asymptotic properties 

Our next result uses the notations m t\i (x) and rrij\i(B) introduced in Sect. 2. We note 
that a version of Lemma 3 was already used in Velez and Prieto-Rumeau (2008). We 
also note that Lemma 3 is an algebraic result (meaning that it depends only on the 
algebraic properties of the weight function). It uses the notation r e R{n) to denote a 
sequence r(n), for n > 1, but, to simplify the notation, we will omit the dependence 
on n. The same convention will be applied in the forthcoming. 

Lemma 3 Let A — {x„}„>i be a sequence in E. Suppose that, for some indices 
i, j € L, the sequence nij\i(x n ) has finite limit mj\i e [0, oo) as n — >• CO. Assume 
also that r e R(n) varies with n in such a way that ri — > oo as n — > oo and r j > 1. 
Under these conditions, 

r j S(A n — x, r — ei) 

lim J 1 =m i \ i VxeA. (3.5) 

n^oo n S(A n — x, r — e j) 

Therefore, ifmj\j > 0, and in addition, rt/(p(n) — > y; > 0 and rj /(p(n) — > yj > 0 
for some sequence (p(n) f oo, then we have 

S(A n — x, r — ef) y, 

lim VTT : T = - m iM Vx e A. (3.6) 

n^oo S(A„ — x, r — e j) yj 

Proof When n is large enough so that x e A n , the following identity is readily 
established: 

^ m j(x q ) S(A n — x — x q , r — e ; - — ef) — r j S(A n — x, r — e,) 

(to see this, just count the number of terms in each side). Thus 
rj S(A n — x, r — e,) 

— — = > mj\i(x q ) a„(x q ), 

Ti S(A n - x,r — en . 



with 



a . ^ _ mj(x q )S(A n - x - x q , r - g - ej) 
q n S(A n -x,r -ej) 
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We note that the a n (x q ) satisfy 

Za n (xq) — 1 and lim a n (x g ) — > 0 

Xq€A n —X 

for every fixed q provided that r, — > oo. Indeed, 

e 

S(A n - x, r - ej) = ^mi(x q )S(A„ - x q , r - ej - e,) 

i=0 

yields r,a„(x ? ) < 1. Hence, (3.5) is a consequence of the Toeplitz lemma (see, e.g., 
Loeve 1977, p. 250), while (3.6) easily follows. □ 

Proposition 2 Let Y be a random assignment process on (E, m) and let A be any 
sequence in E. 

(a) If Ni(A) — oo and mj\i(x n ) has a finite limit m,j\i G [0, oo) as n — > oo then, 
almost surely, 

Nj(A n ) 

lim — = — mm V x e A. (3.7) 

Hence, %j (*)/§ ; (x) is a.s. constant (that is, it does not depend on x e A) when 
rtij\i > 0. 

(b) If\imsup n ^ 00 Nj(A n )/n > 0 and lim„^oo mj\i(x n ) — oo, then Nj(A) < oo 
almost surely. 

Proof (a) Assume that co e £2 is such that Nj{A) — oo, and therefore, > 0 for 
all x e A (see Proposition 1). If Nj(A) — 0 and %j(x) — 0, then the stated result is 
obvious. Otherwise, suppose that f ; (x) > 0 and 2V; (A) > 0. Applying Lemma 3 with 
r — N(A n ), we get 

Nj(A n ) S{A n -x,N(A n )- ei ) 

Ni(A n ) S(A n -x,N(A n )-ej) 7| " 

and as a consequence of (3.3), the limit (3.7) indeed holds. 

(b) To prove this statement, we proceed by contradiction. So, we suppose that 
mj]i(x n ) — > oo and Nj(A) — oo. We apply the case (a) above by interchanging the 
roles of i and j so as to obtain 

Nj(A n ) S(A„-x,N(A n )-ej) 
Nj(A n ) ' S(A n - x, N (A„) - a) ~^ ' 

which yields 

Nj(A„) _^ 
Nj(A„) ~^ 
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Now, since Nj(A n ) < n, the above limit is not compatible with the fact that 
lim sup,,^^ Ni (A n )/n is positive. We conclude that, necessarily, N;(A) is finite. 

□ 

Remark 4 Under condition (A) — recall Sect. 2 — the limit 

m — lim m{x n ) e (0, oo) L 

n— >oo 

exists and rriju — m j/rrij > 0 for all ;, j e L. We thus conclude from Proposition 
2(a) that §,•(#) = £j for every x e A, where § e A^ is -measurable. Moreover, 
Nj(A n )/Ni(A n ) ^jmj/^mi and since 

(N 0 (A n )/n, Ni (A n )/n, Ni{A n )/n) 

must have some limit point in Af , we easily get that Nj(A n )/n — > fym,/!- • m almost 
surely for all i e L. This is the strong law of large numbers formulated in Theorem 
3.4 in Velez and Prieto-Rumeau (2008). 

Our next lemma is, in fact, an algebraic result (which does not depend on the random 
assignment process itself). The notation, however, is greatly simplified using condi- 
tional expectations related to the random assignment process. Lemma 4 below allows 
to derive a first bound on the growth rate of N j (A„), which is given in Proposition 3. 

Lemma 4 Let A be any sequence in E. For r e R(n) such that ri , r j > 1 and every 
x e A we have 

S(A — x r — e ) 

r J irT 1 T = E[«j|i(Ai) I N(A„ -x) = r- ej] (3.8) 

S(A„ — x, r — e j) 

where A l n is the random set {x' e A„ — x : Nj(x') — 1}. 

Proof Let xq e A„ be fixed. If B\, . . . , Bg. are arbitrary disjoint subsets of A n — xq 
with #Bjt — r^, for k ^ j, and #B j = r; — 1, the following identity follows: 

^ \ m\(x) ■ ■ ■ Y[ mi{x) m j\j{Bi) — rj 5(A„ - x 0 , r - e,). (3.9) 

B 1 ,...,B t xeB 1 x£B t 

Indeed, the sum in the lefthand side would give S(A n — xq, r — ej) in the absence of 
mj\i(Bi). This latter factor replaces (x) with nij{x) for some x e B,, augmenting 
B; with x and reducing B, accordingly, so that each term of S(A„ — x, r — e,) is 
repeated r ; - times. 

Now, according to (2.2), 

J m\{x) \\ mi{x)/S{A n - x 0 , r - ej) 
xeB\ xeBt 

is the probability, conditional on N(A n — xq) = r — ej, that the indices 1, . . . , I will 
be attributed to the points in 2?i, . . . , B^, respectively. This completes the proof. □ 
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Proposition 3 Let Y be a random assignment process on (E, m) and let A be any 

sequence in E. For all i, j G L such that Ni (A) > 0 and Nj (A) > 0, we have almost 
surely 

Nj(A n ) Sj(x) 
lim sup — < — V x e A . 

n— >oc m j\i (An) £/(*) 

Proof Since the righthand term of (3.8) is bounded by m,|;(A ra ), by replacing r with 
N(A n ) we get 

XT ... S{A n -x,N(A n )- ei ) 
S(A n -x,N(A n )-ej) 

Now, according to (3.3), the stated result follows. □ 

The relevant conclusion of this proposition is that N j(A n )/mj\i(A n ) remains 
bounded. We make use of this fact in the next result. 

Corollary 2 Let Y be a random assignment process on (E,m) and let A be any 
sequence in E. 

(a) Ifi,j G L are such that Nj (A) > 0andmj\i(A) < 00, then N j(A) < oo almost 
surely. 

(b) If i, j G L are such that lim sup^^^ Nj(A n )/n > 0 and limns.^ mi\j(x n ) — 0, 
then N j (A) — 0 almost surely. 

Proof The statement (a) is obvious. Concerning (b), assume that N/(A) > 0. Then 
we would have, almost surely, 

Ni(A n ) 
lim sup < oo. 

n^oo m i\j (An) 

But, on the other hand, 

m i\i(An) , , „ 
mi]j(Xn) ->• 0, 



which contradicts the fact that lim sup n ^ Qa Ni(A n )/n > 0. 



3.2 Regular sequences 

Next, we introduce the concept of a regular sequence. We say that a sequence A = 
l in E is regular if the limit 

lim mj\j(x n ) — m :\t 

n->oo 
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exists (with 0 < ntj\i < oo) for all i,j e L. Then we can define the following 
equivalence relation on L : 

i ~ j <^=^ nij\i e (0, oo). 

Furthermore, the equivalence classes may be totally ordered by means of the strict 
order relation: 

j < i <^=4> mj\i = 0. 

Summing up, the set L is totally pre-ordered by the growth rate of the sequences 
ntj\i(A n ), This order, of course, depends on the regular sequence A. 

Let A be a regular sequence. As explained in Remark 3, we will now suppose that 
the probability measure P is such that ¥(£2m ) = 1 for some fixed M C L . We may thus 
assume that N t (A) > 0 and (x) > 0 for all i e M and x e A, whereas Nj (A) = 0 
and (x) = 0 if i £ M and x e A. 

The set M can be decomposed as 

M = C 0 UCi U -UCj (3.10) 

where Co, C\, . . . , C s are ordered equivalence classes of the indices in M. That means 
i ~ y when (',7 e C p , and 7 -< i if i e C p and j e C p +\. We will also use the notation 
j -< C p , meaning that j -< i for all ; e C p (or equivalently, j e for some k > p). 
Similarly, we will write Co >- C\ >-•••>- C s . 

It is obvious that a random assignment process remains unchanged when each 
m/ (x) is replaced with c; ■ m, (x) for some constant c, e (0, 00). Thus, to avoid a more 
cumbersome notation, let us choose an arbitrary index i in each C p and replace mj (x) 
with mj\jinj(x) for all j e C p . Then we have mj\j — 1 whenever ; ~ j. 



4 Proof of the main results 

Our next results are aimed towards establishing a strong law of large numbers. 

Let A be a regular sequence and suppose that the probability measure P is such 
that P(Qjvf) = 1 for some fixed M C L. Clearly, there is some i e M with 
lim sup,^^ Ni(A n )/n > 0. Then i e Co [(recall (3.10)] since, according to part 
(b) of Corollary 2, 2 e M — Co would imply N j (A) = 0 for all j & Co. Moreover, by 
Proposition 2(a), we have, almost surely as n —> 00, 

„ , . . ->• v,'|,- e (0, 00) Vi'eCo and / -» 0 V;eM-C 0 . 

Now, X/sM Nj(A n ) — n may be written as 

j = jVKAJ jV,-(A„) jV,-(A„) 7V 7 -(A„) 



, M(A„) n ^ M(A„) 

reCo jeM— Co 



Springer 



R. Velez, T. Prieto-Rumeau 



and taking into account the preceding remarks, this yields (almost surely) 
lim — — — — = Vj > 0 V i e Co with ^ v,- = 1 . 

n— too n t— 1 

ieCo 

Comparing with (3.7), for any i, j e Cq we have §; (x) /§; (x) — Vj / v, . Therefore, for 
every x e A, 

tji(x) ' ao(x) Vi where a 0 (x) = ^ 

ieCa 

Call No(A n ) = X/eCo ^i(A B ). Then we have No(A n )/n — > 1, but it may happen 
that n — No(A n ) remains bounded (for instance, if mj\i(A) < oo for all i e Co and 
j e M — Co, it will be Nj(A) < oo for all j e M — Co). On the contrary, when 
m;\i(A) — oo for some j e C\ and any i e Co, we may have Nj(A) — oo. In this 
case, the assertion of Proposition 2(a) gives, almost surely as n — > oo, 

— ► v,-/i; 6 (0, oo) V / e Ci and ^0 Vfc^Ci. 

Then, the equality 

j _ Nj(A n ) y jV/(A„) jV./(A„) ^ Nk(A„) 

~ n - N 0 (A„) (A„) n - /V 0 (A„) ^ (A„) 

shows that almost surely 

lim ; - = v/ > 0 V / e Ci with > v, = 1. 

»-°° » - AT 0 (A„) 7 ^ 

Again, the comparison with (3.7) yields, for all y e Ci and x e A, 
%j(x) — a\{x)vj where u\(x) — ^ §;(x). 

Letting N p (A n ) — X/ec p Nj(A„), the argument above may be pursued similarly. 
At each step it may happen that the indices j of the next C p + 1 are such that N t ■( A ) < oo 
(a sufficient condition for this is thatmj|j(A) < oo for some i > j). Or, if m;|;(A) = 
oo for all i > j, it may be Ni (A) = oo, and in this case, almost surely as n —> oo, 



Nj(A n ) 



— > vj > 0 Vj e C p +\ with ^ Vj = 1. 



n-Tr< p N,(A n ) 
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Furthermore, we have, for all j e C p +i and x e A, 

Hj{x) = <Xp+i(x) v h 

where a p+l (x) = Z./eC p+ , ?jW' 

We will assume that M C L is a set of indices, which is decomposed into ordered 
equivalence classes; recall (3.10). In what follows, we will suppose that the regular 
sequence A satisfies, in addition, the condition (A*). This allows to have Nj(A) — oo 
for all i e M, and we will show that this indeed holds. 

Lemma 5 Assume that the sequence A verifies (A*) and that r e R(n) varies with n 
in such a way that, for all i e Co, j € C\, and k < C\, as n — > oo it is 

ri/n^yj, rj/mj\i(A n ) ->• yj, and n/mj\i(A n ) 0, 

where yi > Ofor every i e Co and X/eCo ^' ~ ^ Then, for any i e Co and j e C\, 
we have 



lim 



S(A n -x,r -ej) 



yj 



Vjc e A 



n^oo S(A n - x, r - ei) yt 
provided that the latter limit is finite for some i e Co- 
Proof Let i e Co be such that 

S(A n -x,r-ej) 

hm — — p 

n^oo S(A„ — x, r — Ci) 

for some finite p. Summing up the equalities (3.8) for the different values of e Co 
we get 



S(A 



_ 1 _ - X S(A " ~ x r ~ C i') = E Z D " 
" X ' r i'eCa L /' e Co 



(4.1) 



where D„ = {N(A„ — x) = r — e j}. According to (3.6) and recalling that = 1, 
the lefthand term of (4.1) is of order yjmj\i(A n )/(P yi) and diverges when n — »• oo 
for j e C\. Regarding the righthand term, fix any e > 0 and let q E be such that 
1 — e < nii\i'(x q ) < 1 + e for all q > q E . Then we have 



(1 - e)m ni (A l n - A qs ) < m jW {A l n - A qs ) < (1 + e)m ni (A' n - A qs ) 



and 



(1 - s)m ni (A° n - A qs ) + T<J^ m nr (Ai) < (1 + e)m n ,(A* - A qF ) + T, 

i'eCo 
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where T is the bounded term Xi'eCo m iV 

(A*' n A qc ) and A° = ^reC 0 Mi- Therefore, 



E[(l - s)m ni (A° n - Ag E ) + T | D„] < E 



< E 



m nv (A^)\D n 

L I'eCo 

{l + e)m ni {Al-A qe ) + T \ D„ 



and the divergence of the lefthand term of (4.1) shows that E[my|,(A°) | D„] — >■ oo. 
Hence, if the above inequality is divided by E[mj\i (A° n ) \ D n ], we get 



3 



X m j]r (4) | D„ 
L i'eCo 



E[ mjli (A 0 n ) | D n ] 



Now, if B„ is an arbitrary subset of A„ — x with 
it is 



m j\i(A n ) - maxm ni (B n ) < E[mj\i(A°) \ D„] < ntj\i(A n ) - ndnmj\i(B n ). 



Moreover, if m^i(x q ) < s for q > q £ , we have 



max»„ m ,i;(fi ra ) 
< m ni {A qs ) + ej^r k and - 



« 7 '|i(A„) 



Consequently, E[m,|,'(A^) | D n ] ~ m,|,(A„). Finally, (4.1) gives /J = yj/yt, and 
more generally, the stated result holds for all i e Cq. □ 

Our first results towards the law of large numbers are Proposition 4 and its contin- 
uation, Proposition 5. 



Proposition 4 Let Y be a random assignment process on (E, m) and let A be a 
sequence in E that verifies the condition (A*). Assume further that P(S2^) = 1 for 
some M C L (recall Remark 3), and that M — Up =0 Cp, where Co >- C\ >- ■ ■ ■ >- C s 
are equivalence classes of indices [(see (3.10)]. Then, with probability 1, for all x G A, 

(a) lim = Vi — — — for all i € Cq. 



n-roo n 



a 0 (x) 



N j(A n ) a\(x)v; 

(b) lim — : = = c\Vi for all j e C\ and i e Cq. 

n^oomj\i(A n ) ao(x) 
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Proof Part (a) has already been proved. Now, Proposition 3 ensures that there are 
subsequences of n with N j(A„)/m f\i(A n ) — > yj for all j e C\ and any i G Co. 
According to Prosposition 2(a), along these subsequences, N k {A n ) I m iu (A n ) — »■ 0 
for all k -< C\ and 

S(A n - x, N(A„) - ej) %j(x) ai(x)Vj 

> — — = Vx g A 

S(A n -x,N(A n )-ei) a 0 (x)v,- 

when j G C\ and i e Co- Lemma 5 is therefore applicable to the corresponding 
subsequence of r — N(A„) and gives 

S(A„ -x,N(A n )-ej) ^ yj VxeA 
S(A n — x, N(A n ) — e{) vi 

Hence, y; equals a\ (x)vj /ao(x), and the whole sequence converges: 

Nj(A n ) ai(x)Vj 



mj\i(A n ) a 0 (x) 



Vx g A. 



It then follows thatai (x)/cto(x) must have a constant value c\, which does not depend 
on x e A. □ 

Lemma 6 Assume that the sequence A verifies the condition (A*) and that r G R(n) 
varies with n in such a way that, for all i G Co, /' G C\, k G C2, and I < C2, and as 
n — > 00, 

nln ->• y ; , rj/mj\i(An) yj, r k /m k \i(A n ) -> y*, and ri/tnk\i(A n ) 0, 

where y, > 0/or eac/z i € Co U Ci XiieCo ^' = ^' -^ en ' / or an 3' ( e ^0 
£ G C z , 

S(A„-x,r-e k ) y k 

hm = — Vx G A, 

n^oo S(A n - x, r - e ( ) y,- 

provided that the limit is finite for some i G Co- 

Proof As in Lemma 5 we obtain, for any k G C2 and s G Co, 



S(A„ -x,r -et) . 

ieCo 



where now we let D n — {N(A n — x) — r — e k }. But 



m w (A n ) >E[m t |i(A°) I AJ 



2 S(A„ - x, r - «,) ~ E[m*|;(A°) | D„], (4.2) 



> m*|,(A„) - £ E[mi|,(A^) | D„] - £ E[m*|,(A*) | D„], 
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and for the last terms, if m k \i(x q ) < s when q > q e , it is E[m£|;(A„) I D n ] < 
m k\i (Aq e ) + er k , so that E[mfc|; (A k n ) \ D„]/m k \j(A n ) — >• 0. For the terms correspond- 
ing to j e Ci, if m.j\i (x q ) < £ as well for q > q e , it is 

E[m*|,(Aj() | D n ] < m kV (A qe ) + eE[m ku (A } n ) \ D n ]. 
Now, from (3.8) applied to (A:, and (k, j) and Lemma 5, we get 

E[m k \j(Ai) | D„] = S(A n -x,r-ej) _ ^ yj_ 
E[m kli (A' n ) | D n ] ~ S(A n -x,r- ei ) ~^ y t 

andE[m k]i (A J n ) \ D n ]/m k \i(A n ) 0. Therefore, 

E[m k]i (A° n ) | D n ] ~ m k \i(A n ). 

Together with (4.2), this easily gives the stated result. □ 

Our next result is the second part of Proposition 4. 

Proposition 5 Under the conditions of Proposition 4, with probability 1 and for all 
x e A, 

N k (A„) oi2(x)v k 

(c) lim = = C2V k for all k e Ci and i e Co- 

n-s-oo m k \i(A„) oto(x) 

Ni(A n ) oip(x)vi 

(d) For p > 2, lim = — = c„vi for all I e C„ and i e Co- 

n->oo m/|, (A„) Qt 0 (x) 

As a consequence, a p (x) has a constant value a p for each p — 1, . . . , s, and 
has also a constant value %i for each i e M. 

Proof From Proposition 4, 

Ni(A n )/n^Vi Vie C 0 and Nj(A n )/mj\i(A n ) c\Vj VjeCi. 
As a consequence of Proposition 3, there are subsequences of n with 

N k (A n )/m k \i(A n ) ->■ y k 

for each k e C2 and z e Co; and along such subsequences Ni(A n )/m k \i (A n ) — > 0 for 
each I -< Ci- Furthermore, for x e A, 

S(A n - x, N(A n ) - e k ) _ ^ &(■*) _ <*2(x)vk 
S(A n - x, N(A n ) - e t ) %i(x) a Q (x)Vi 

when k e C2 and i e Co- Lemma 6 can be therefore applied to the corresponding 
subsequence of r — N(A„) and gives 

5(A„ -x, N (A„) - e k ) 

S(A n - x, N(A„) - a) vi' 
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Then the whole sequence converges: Nk(A n )/mk\i{A n ) — >• ct2{x)vk / giq(x) for all 
x G A. Hence, o^OO /&o( x ) must have a constant value C2- 

The proof of (d) requires a generalization of Lemma 6, using similar arguments, 
and it is omitted. 

Finally, since 1 = ^f p= oOi p (x) — ao(x) ^1 + X/>=i c />)' we conclude that 
ao(x) — ao and oc p (x) = aoc p = a p . Hence, for all i e M, = a p v,- = □ 

The previous results may be summarized in the following strong law of large numbers. 



Theorem 2 If Y is a random assignment process on (E, m) and A is a sequence 
that verifies the condition (A*), then there exists a Q ^-measurable probability vector 
§ G A( such that given a subset M C LwithV(Q,M) > 0, and such that M — Ll s p=0 C p , 
where Co > C\ >-••■>- C s are the corresponding ordered equivalence classes, we 
have, almost surely in Q,m, 

lim — Vi e Co 

n-»oo n ao 

and 

Nj(A n ) %j , . 
lim — = — V i e C 0 , j e M - C 0 , 

n-s-oc »jy|/(A n ) a 0 

where ao = 52ieCn N j(A) — %j — 0 w/ien 7 0 M. 

Next, we will establish the De Finetti theorem. Our next lemma is a consequence 
of Lemmas 5 and 6. 

Lemma 7 Assume that the sequence A verifies the condition (A*). Let M C L be a 
subset of indices [(recall (3.10)7, and suppose that r G R(n) varies with n in such a 
way that, as n — > 00, 

ri/n — > yi Vi e Co and rj/mj\j(A n ) — »■ yj V j G M — Co, 

where yi > 0/or every i e M and ^' = ^ 

faj For all i, j G M, 

S(A„, /•-«;) v/ 

lim = — . 

n^oo r -a) yi 

(b) Let yk = 0/or the indices k £ M. Then, for all B G B with B C E — A, and any 
k G R(#B) such that kj — Ofor i M, it is 

S(A n ,r- k) = (4 .3) 
n^oc S(BU A„,r) T\ xeB ym(x) 

where k Q — #B-k ifO e M. 
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Proof (a) If A = {x q } q >i is a regular sequence satisfying (A*), then so is A' — {x' q } q >\ 
given by x[ — x for any x e E, and x' q — x q -\ for q > 2. Then, Lemmas 5 and 6 
applied to A' and x yield the stated result. 

(b) We begin with the case B = {x} and k — e / with j e M. Then, by part (a), 



S(A n U{x},r) ^ S{A n ,r-ei) ^ y; y • m(x) 

= > m,(x) >■ > max) — = . 

S ( A ^r-ej) ^ S(A n ,r-ej) y . y . 



Now, if B — {x, x' , . . .} then the limit (4.3) follows by recursively considering the 
sequences A U [x], A U {x, x'}, etc. □ 



Now we are ready to prove the De Finetti theorem. 



4. 1 Proof of Theorem 1 

First assume that F(£2m) — 1 f° r some subset M C L (see Remark 3). For any B e B, 
the sequence A may be shifted to get B C E — A. Then, apply Lemma 2 with C — B 
to get, for k e R(#B), 

S(A„, N(B U A„) - k) 
F{N(B) = * | Gbua) = S(B, k) lim "' / — ^ - / . 

n-»oo 5(B u A n , N(B U A„)) 

But, according to Theorem 2, for some Gaub -measurable (and so, Ga -measurable) 
probability vector § e Am 



Ni(B U A n )/n -> f,/ao Vi 6 C 0 and /^(B U A n )/m 7 | ! -(A„) -> £//«(> 
for all 7 e M — Co- Thus, Lemma 7 applied to the sequence r — N(B U A„) gives 



P{iV(fi) = A: | g B uA} = S(B,k) 



\{ xeB k-m{x) 



(Note that if ki > 0 for some i £ M, then the above conditional probability vanishes 
because = 0, which is consistent with the definition of Qm-) Since £ is Gaub- 
measurable, 



P{jV(5) = = E[P{JV(B) = A: | 0 BUA } | J] = S(B, k) 



ILe/»$ -mix)' 

(4.4) 
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Now, from (2.2), for any B e B, r e R(#B) with r, = 0 for i ^ M, and any disjoint 
subsets Bj with = r, , for z e M, we get 



f){y(*) = i, Viefi,l |£ 



= P{^V(5) = r | -J— J] l\ mix) 



which shows the conditional independence of [Y(x)} x& e given if. 

In the case of a general probability measure P (not necessarily supported on 
some since P is the convex linear combination of several Pmj , Pm 2 > ■ ■ • con- 

centrated on disjoint Q,m x ,Q,m 2 , . . ., one can define a unique § e that coincides, 
in each &m> Wim the corresponding §. The conditional independence given § is then 
obtained by linearity, as well as (4.4). Now, (2.9) easily follows and the proof of 
Theorem 1 is now complete. 



4.2 Proof of Corollary 1 



Assume that g A has been completed in T . According to (4.4), 



¥{N(A n ) = k | §} = V{N(A n ) = k | g A }, 



and so E[V | £] = E[V | £a] for any integrable function V = <p(N(A n )). Let £ 
be any integrable g A -measurable function. Now V m — K[£\N(Ai), . . . , N(A m )] is a 
closed martingale converging a.s. to £ as m — s- oo. And therefore, almost surely 

£ = iimE[y m | g A ] 

m 

= limE[E[V m | g A j | g A ] 

m 

= limE[E[V m | N(A m )] | g A ] 

m 

= limE[E[V m | N(A m )] | f] 



because V m and [Y(x)} X eA c are conditionally independent given N(A m ) and the inner 
conditional expectation is an integrable function of N(A m ). Hence, £ is the almost 
sure limit of a sequence of a (§) -measurable functions. Thus g A is the completion of 
tr(M). 

Now, assuming that er(£) is completed in T, we have o(%) — gsuA C <?s for 
any B e B (since 5 U A is a regular sequence satisfying the condition (A*)). Hence 
Ge' — C\BeB,BcE' Sb D er(£), while on the other hand, Q E i C g A — er(£). 

This completes the proof of Corollary 1 . 
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5 Application to an estimation problem 

In this section we show an application of the De Finetti Theorem 1 and the strong law 
of large numbers in Theorem 2 to an estimation problem. 

Suppose that I channels flow into a reservoir, where the channel i has an unknown 

flow of Zi particles per time unit (t = 1, 2, . . .). for each ; = 1 1. The problem is 

to estimate the proportion of particles in the reservoir that come from channel i , that 
is, the quantities 

Pi — — for ; = 1, . . . ,£., 

zi H h zi 

with the restriction that we cannot directly take samples from the channels, and instead, 
sampling from the reservoir is allowed. 

The proposed solution consists in adding some "distinguishable" particles of, say, 
type / to the flow of channel Then, by sampling particles from the reservoir and 
counting the number of such distinguishable particles, we will propose estimators of 
the pi . The consistency of these estimators will be proved using the De Finetti theorem 
and the law of large numbers developed in this paper. 

We assume that (zi, . . . , zi) is an unobservable random vector taking values in 
(0, oo) . At each time t > 1, we add a proportion /,, f > 0 of particles of type i to 
the flow of channel i. Therefore, at each time t > 1, the reservoir receives z, normal 
particles (of type 0) and fijZi particles of type i that come from channel i. So, at time 
t > 1, the composition of the reservoir is: 

• (zi + ■ ■ • + zt)t particles of type 0; 

• nFij — Zi ■ Xi=i fi,s particles of type i, for each 1 < i < I. 

The estimation procedure is to pick, at each time t > 1 , a particle from the reservoir. 
We denote by Y{t) e {0, 1, . . . , 1} the type of this sampled particle. Upon observation 
of the sequence {T(f)}, we must estimate the proportions p, . Let us now show that 
{Y(t)} t >i is a random assignment process on the set E of times t — 1,2,.... 
Given B eBwdr e R(#B), we have that F{N(B) = r) equals 

¥{N(B) = r) = E 

where the sum ranges over all partitions B, of B with #Z? ; = r ; for i — 0, . . . , i. 
Hence, 

z nn 

B 0 ,...,B e i = l teBi 

This suggest the following definition of the weight function m. Let 
m,-(f) = Fjj/t for i — I, and mp(f) = 1 
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B 0 ,...,B t t£B 0 



nn 



ZiFi 



i.i 



(zi + • ■ ■ + z t )t 



ZjLi zi (f + Ft,t) i = \ ,\i 2Xi ^ ( r + f m) 



P{N(B) = r] = E 



(zi 



i = l 
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for t > 1. Also, let 



G(B, r)=E 



(zi 



zir n 



i = l <•! 



We have thus shown that 

P{N(B) = r} = 5(5, r)G(fi, r). 

Similarly, if {x\, . . . , Xk) c 5 we have 

F{N(B)=r,Y( Xl ) = h,...,Y(x k ) = i k } 

= S(B - {x\, ...,x k ], r - (e h H he, ( .)) ■ G(B, r) ■ m h (x{) ■ ■■m ik (x k ), 



while for {yi, 



y n } n B — 0 we have 



¥{N(B) = r, Y(xi) = i u 



Y(x k ) = h,Y(y 1 ) = j 1 , 



Y(y„) = j n ) 



S(B - [xi, . . .,xk), r - (c/, + 
G(BU{y u 



0) 



y n \, r 



• m,j (xi) • • ■ m ;t (jc k ) ■ m ;i (yi) ■ ■ • m jn (y n ). 

From the above equalities, it follows easily that the random variables Y(xi) are 
conditionally independent of Y (yj) given N(B). Hence, the condition (CI) is satisfied. 
It is also straightforward that (C2) is satisfied. Hence, the random variables {Y(t)} r >\ 
are a random assignment process with weight function m as defined above. 

Now we note that 



G(B,r) = E 



LiWs + zLi^cof) 



Therefore, letting 



we have 



¥{N(B) 



$ = (l/2,pi/2,..., w /2) 



where F denotes the distribution of § . 

Therefore, the random variables {Y(t)} t >i are conditionally independent given the 
Pi. Besides, when condition (A*) is satisfied, then the strong law of large numbers 
yields almost sure consistent estimators of the relative flows p, . At this point, there 
are several possible choices of the frequencies fj t . 
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• If f it — a for some positive constant c,- and alii > 1, then F,t — c\t (i.e., we 
add the same proportion of distinguishable particles at each time t). In this case, 
condition (A*) is satisfied and we have that all the indices 0, 1, . . . , £ belong to 
the class Co. Therefore, 

2(M-(1) + --- + M(0) 

> Pi with probability one as t — > oo. 

The random variables {l'(f)} are exchangeable and they are not independent. 

• An interesting choice, which does not require to add so "many" distinguishable 
particles is — c,- > 0 and /, f = 0 for t > 2; that is, we add distinguishable 
particles just at the initial time t — 1 . We have F^ t — c, . The condition (A*) holds, 
but now 

C 0 = {0} and C\ = {!,...,£}. 
The strong law of large numbers gives 
A^o(l) H h A^o(0 

> 1 with probability one as t — >• oo , 

that is, the limiting proportion of distinguishable particles in the reservoir vanishes. 
The consistent estimator is now 

N i {\) + --- + N i (t) 

> pi with probability one as t —> oo. 

a log t 

In this case, the random variables { Y (t )} are neither exchangeable nor independent. 



6 Conclusions 

In this paper, we have given sufficient conditions for a random assignment process 
{Y(x)} x£ e on (E, m) taking values in L — {0, 1, ...,£} to verify a strong law of large 
numbers and a De Finetti theorem. Namely, it suffices that there exists a sequence 
A — {x„} n >i C E such that the limits 

mj{xn) 
lim — 

n-foa mi(x n ) 

exist for all i, j e L, and in addition, 

ntj(x n ) 



z 



, mi(x n ) 



oo for all i, j e L. (6.1) 



For the particular case of a random selection process (in the terminology of Velez and 
Prieto-Rumeau 2009, 2010, 2011), that is, when t = 1, the weight function m takes 

Springer 



Random assignment processes 



the particular form 



m(x) = (niQ(x), m\(x)) 



1 m(x)) for x e E. 



Then the condition (6.1) becomes 



OC 



CK! 



/ m(x n ) — oo and 
n=l 




(6.2) 



n=l 



It is shown in Velez and Prieto-Rumeau (2010) that (6.2) is also a necessary condition 
for the random selection process to verify a De Finetti theorem. In this sense, an 
interesting open issue is to know whether the existence of a regular sequence A C E 
that satisfies (6.1) is a necessary condition for the De Finetti theorem. 

Finally, a challenging issue — and likely to be fairly complicated — is to generalize 
the results in the present paper to the case of a random assignment process with a 
denumerable or continuous set of indices L. 
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